Confidence-Based Demonstration Selection for Interactive Robot Learning
نویسندگان
چکیده
Effective learning by demonstration techniques enable complex robot behaviors to be taught from a small number of demonstrations. Demonstrations are obtained based on a selection algorithm, which governs which states are labeled by the human teacher. In this work, we examine selection algorithms used by the robot to request demonstration examples. Previous approaches typically rely on a fixed confidence threshold. In this work, we highlight the drawbacks of using a single threshold, and contribute an algorithm for automatically setting multiple confidence thresholds designed to target domain states with the greatest uncertainty. Our evaluation compares the proposed multi-threshold selection method to confidence-based selection using a single fixed threshold, and manual data selection by the teacher. Our results indicate that the multi-threshold approach significantly reduces the number of demonstrations required to learn the task.
منابع مشابه
Confidence-Based Robot Policy Learning from Demonstration
The problem of learning a policy, a task representation mapping from world states to actions, lies at the heart of many robotic applications. One approach to acquiring a task policy is learning from demonstration, an interactive technique in which a robot learns a policy based on example state to action mappings provided by a human teacher. This thesis introduces Confidence-Based Autonomy, a mi...
متن کاملCan We Learn Finite State Machine Robot Controllers from Interactive Demonstration?
There is currently a gap between the types of robot control polices that can be learnt from interactive demonstration and those manually programmed by skilled coders. Using regression-based robot tutelage, robots can be taught previously unknown tasks whose underlying mappings between perceived world states and actions are many-to-one. However, in a finite state machine controller, multiple sub...
متن کاملInteractive Policy Learning through Confidence-Based Autonomy
We present Confidence-Based Autonomy (CBA), an interactive algorithm for policy learning from demonstration. The CBA algorithm consists of two components which take advantage of the complementary abilities of humans and computer agents. The first component, Confident Execution, enables the agent to identify states in which demonstration is required, to request a demonstration from the human tea...
متن کاملA Practical Comparison of Three Robot Learning from Demonstration Algorithm
Research on robot Learning from Demonstration has seen significant growth in recent years, but the field has had only limited evaluation of existing algorithms with respect to algorithm usability by naïve users. In this article we present findings from a user study in which we asked non-expert users to use and evaluate three different robot Learning from Demonstration algorithms. The three algo...
متن کاملA Case-Based Framework for Task Demonstration Storage and Adaptation
We address the problem of imitation learning in interactive robots which learn from task demonstrations. Many current approaches to interactive robot learning are performed over a set of demonstrations, where the robot observes several demonstrations of the same task and then creates a generalized model. In contrast, we aim to enable a robot to learn from individual demonstrations, each of whic...
متن کامل